imaging study
The Optimization Paradox in Clinical AI Multi-Agent Systems
Bedi, Suhana, Mlauzi, Iddah, Shin, Daniel, Koyejo, Sanmi, Shah, Nigam H.
Multi-agent artificial intelligence systems are increasingly deployed in clinical settings, yet the relationship between component-level optimization and system-wide performance remains poorly understood. We evaluated this relationship using 2,400 real patient cases from the MIMIC-CDM dataset across four abdominal pathologies (appendicitis, pancreatitis, cholecystitis, diverticulitis), decomposing clinical diagnosis into information gathering, interpretation, and differential diagnosis. We evaluated single agent systems (one model performing all tasks) against multi-agent systems (specialized models for each task) using comprehensive metrics spanning diagnostic outcomes, process adherence, and cost efficiency. Our results reveal a paradox: while multi-agent systems generally outperformed single agents, the component-optimized or Best of Breed system with superior components and excellent process metrics (85.5% information accuracy) significantly underperformed in diagnostic accuracy (67.7% vs. 77.4% for a top multi-agent system). This finding underscores that successful integration of AI in healthcare requires not just component level optimization but also attention to information flow and compatibility between agents. Our findings highlight the need for end to end system validation rather than relying on component metrics alone.
- North America > United States > California > Santa Clara County > Stanford (0.05)
- North America > United States > California > Santa Clara County > Palo Alto (0.05)
- Asia > Middle East > Israel > Jerusalem District > Jerusalem (0.04)
- North America > United States > Massachusetts (0.04)
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (1.00)
HOPPR Medical-Grade Platform for Medical Imaging AI
Slavkova, Kalina P., Traughber, Melanie, Chen, Oliver, Bakos, Robert, Goldstein, Shayna, Harms, Dan, Erickson, Bradley J., Siddiqui, Khan M.
Technological advances in artificial intelligence (AI) have enabled the development of large vision language models (LVLMs) that are trained on millions of paired image and text samples. Subsequent research efforts have demonstrated great potential of LVLMs to achieve high performance in medical imaging use cases (e.g., radiology report generation), but there remain barriers that hinder the ability to deploy these solutions broadly. These include the cost of extensive computational requirements for developing large scale models, expertise in the development of sophisticated AI models, and the difficulty in accessing substantially large, high-quality datasets that adequately represent the population in which the LVLM solution is to be deployed. The HOPPR Medical-Grade Platform addresses these barriers by providing powerful computational infrastructure, a suite of foundation models on top of which developers can fine-tune for their specific use cases, and a robust quality management system that sets a standard for evaluating fine-tuned models for deployment in clinical settings. The HOPPR Platform has access to millions of imaging studies and text reports sourced from hundreds of imaging centers from diverse populations to pretrain foundation models and enable use case-specific cohorts for fine-tuning. All data are deidentified and securely stored for HIPAA compliance. Additionally, developers can securely host models on the HOPPR platform and access them via an API to make inferences using these models within established clinical workflows. With the Medical-Grade Platform, HOPPR's mission is to expedite the deployment of LVLM solutions for medical imaging and ultimately optimize radiologist's workflows and meet the growing demands of the field.
- Research Report (0.66)
- Workflow (0.56)
Evidence Is All You Need: Ordering Imaging Studies via Language Model Alignment with the ACR Appropriateness Criteria
Yao, Michael S., Chae, Allison, Kahn, Charles E. Jr., Witschey, Walter R., Gee, James C., Sagreiya, Hersh, Bastani, Osbert
Diagnostic imaging studies are an increasingly important component of the workup and management of acutely presenting patients. However, ordering appropriate imaging studies according to evidence-based medical guidelines is a challenging task with a high degree of variability between healthcare providers. To address this issue, recent work has investigated if generative AI and large language models can be leveraged to help clinicians order relevant imaging studies for patients. However, it is challenging to ensure that these tools are correctly aligned with medical guidelines, such as the American College of Radiology's Appropriateness Criteria (ACR AC). In this study, we introduce a framework to intelligently leverage language models by recommending imaging studies for patient cases that are aligned with evidence-based guidelines. We make available a novel dataset of patient "one-liner" scenarios to power our experiments, and optimize state-of-the-art language models to achieve an accuracy on par with clinicians in image ordering. Finally, we demonstrate that our language model-based pipeline can be used as intelligent assistants by clinicians to support image ordering workflows and improve the accuracy of imaging study ordering according to the ACR AC. Our work demonstrates and validates a strategy to leverage AI-based software to improve trustworthy clinical decision making in alignment with expert evidence-based guidelines.
- North America > United States > Pennsylvania > Philadelphia County > Philadelphia (0.14)
- Asia > Middle East > Israel (0.04)
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (1.00)
- Health & Medicine > Therapeutic Area > Psychiatry/Psychology (1.00)
- Health & Medicine > Therapeutic Area > Oncology (1.00)
- Health & Medicine > Therapeutic Area > Neurology (1.00)
- (11 more...)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Chatbot (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning > Generative AI (0.34)
Integration and Implementation Strategies for AI Algorithm Deployment with Smart Routing Rules and Workflow Management
Erdal, Barbaros Selnur, Gupta, Vikash, Demirer, Mutlu, Fair, Kim H., White, Richard D., Blair, Jeff, Deichert, Barbara, Lafleur, Laurie, Qin, Ming Melvin, Bericat, David, Genereaux, Brad
This paper reviews the challenges hindering the widespread adoption of artificial intelligence (AI) solutions in the healthcare industry, focusing on computer vision applications for medical imaging, and how interoperability and enterprise-grade scalability can be used to address these challenges. The complex nature of healthcare workflows, intricacies in managing large and secure medical imaging data, and the absence of standardized frameworks for AI development pose significant barriers and require a new paradigm to address them. The role of interoperability is examined in this paper as a crucial factor in connecting disparate applications within healthcare workflows. Standards such as DICOM, Health Level 7 (HL7), and Integrating the Healthcare Enterprise (IHE) are highlighted as foundational for common imaging workflows. A specific focus is placed on the role of DICOM gateways, with Smart Routing Rules and Workflow Management leading transformational efforts in this area. To drive enterprise scalability, new tools are needed. Project MONAI, established in 2019, is introduced as an initiative aiming to redefine the development of medical AI applications. The MONAI Deploy App SDK, a component of Project MONAI, is identified as a key tool in simplifying the packaging and deployment process, enabling repeatable, scalable, and standardized deployment patterns for AI applications. The abstract underscores the potential impact of successful AI adoption in healthcare, offering physicians both life-saving and time-saving insights and driving efficiencies in radiology department workflows. The collaborative efforts between academia and industry, are emphasized as essential for advancing the adoption of healthcare AI solutions.
- Workflow (1.00)
- Research Report (1.00)
- Health & Medicine > Health Care Technology (1.00)
- Health & Medicine > Diagnostic Medicine > Imaging (1.00)
Radiology Initiatives Illustrate Uses for Open Data and Open AI research
Andy OramFans of data in health care often speculate about what clinicians and researchers could achieve by reducing friction in data sharing. What if we had easy access to group repositories, expert annotations and labels, robust and consistent metadata, and standards without inconsistencies? Since 2017, the Radiological Society of North America (RSNA) has been displaying a model for such data sharing. That year marked RSNA's first AI challenge. RSNA has worked since then to make the AI challenge an increasingly international collaboration.
- North America (0.26)
- South America > Argentina (0.06)
- Europe > Netherlands (0.05)
- Asia > Japan (0.05)
- Health & Medicine > Therapeutic Area (1.00)
- Health & Medicine > Nuclear Medicine (1.00)
- Health & Medicine > Diagnostic Medicine > Imaging (1.00)
Secure and Robust Machine Learning for Healthcare: A Survey
Medical ML/DL system shall facilitate a deep understanding of the underlying healthcare task, which (in most cases) can only be achieved by utilising other forms of patients data. For example, radiology is not all about clinical imaging. Other patient EMR data is crucial for radiologists to derive the precise conclusion for an imaging study. This calls for the integration and data exchange between all healthcare systems. Despite extensive research on data exchange standards for healthcare, there is a huge ignorance in following those standards in healthcare IT systems which broadly affects the quality and efficacy of healthcare data, accumulated through these systems.
- Health & Medicine > Nuclear Medicine (0.62)
- Health & Medicine > Diagnostic Medicine > Imaging (0.62)
AI Helps Ascertain If an Antidepressant Is Likely To Be Effective
The psychiatry field has long sought answers to explain why antidepressants help only some people. Is a patient's recovery due merely to a placebo effect – the self-fulfilling belief that a treatment will work – or can the biology of the person influence the outcome? Two studies led by UT Southwestern provide evidence for the impact of biology by using artificial intelligence to identify patterns of brain activity that make people less responsive to certain antidepressants. Put simply, scientists showed they can use imaging of a patient's brain to decide whether a medication is likely to be effective. The studies include the latest findings from a large national trial (EMBARC) intended to establish biology-based, objective strategies to remedy mood disorders and minimize the trial and error of prescribing treatments.
- Health & Medicine > Therapeutic Area > Psychiatry/Psychology (1.00)
- Health & Medicine > Therapeutic Area > Neurology (1.00)
- Health & Medicine > Pharmaceuticals & Biotechnology (1.00)
Algorithms begin to show practical use in diagnostic imaging
Algorithms based on machine learning and deep learning, intended for use in diagnostic imaging, are moving into the commercial pipeline. However, providers will have to overcome multiple challenges to incorporate these tools into daily clinical workflows in radiology. There now are numerous algorithms in various stages of development and in the FDA approval process, and experts believe that there could eventually be hundreds or even thousands of AI-based apps to improve the quality and efficiency of radiology. The emerging applications based on machine learning and deep learning primarily involve algorithms to automate such processes in radiology as detecting abnormal structures in images, such as cancerous lesions and nodules. The technology can be used on a variety of modalities, such as CT scans and X-rays.
- North America > United States > Ohio (0.06)
- North America > United States > North Carolina > Durham County > Durham (0.04)
- North America > United States > Massachusetts (0.04)
- Europe > United Kingdom (0.04)
- Health & Medicine > Diagnostic Medicine > Imaging (1.00)
- Government > Regional Government > North America Government > United States Government > FDA (0.88)
RadBot-CXR: Classification of Four Clinical Finding Categories in Chest X-Ray Using Deep Learning
Abstract: The well-documented global shortage of radiologists is most acutely manifested in countries where the rapid rise of a middle class has created a new capacity to produce imaging studies at a rate which far exceeds the time required to train experts capable of interpreting such studies. The production to interpretation gap is seen clearly in the case of the most common of imaging studies: the chest x-ray, where technicians are increasingly called upon to not only acquire the image, but also to interpret it. The dearth of expert radiologists leads to both delayed and inaccurate diagnostic insights. The present study utilizes a robust radiology database, machine-learning technologies, and robust clinical validation to produce expert-level automatic interpretation of routine chest x-rays. Using a convolutional neural network (CNN) we achieve a performance which is slightly higher than radiologists in the detection of four common chest X-ray (CXR) findings which include focal lung opacities, diffuse lung opacity, cardiomegaly, and abnormal hilar prominence.
- Health & Medicine > Nuclear Medicine (1.00)
- Health & Medicine > Diagnostic Medicine > Imaging (1.00)
Rush using ML, analytics on images and unstructured data
Rush University Medical Center is adopting machine learning and analytics technologies from two companies to process patient information, including from imaging studies and other sources, with hopes of customizing patient treatment and delivering precision medicine. The Chicago-based academic medical center is using a combination of technology from Cloudera and MetiStream, which are working together on products that providers can use to improve patient outcomes. Cloudera offers a platform for machine learning and analytics optimized for the cloud, while MetiStream develops healthcare analytics solutions. MetiStream offers an interactive analytics platform for healthcare and life science industries built on Cloudera's machine learning platform. By combining machine learning and analytics from Cloudera Enterprise and Cloudera Data Science Workbench, MetiStream contends its Ember product can deliver insights across massive volumes of handwritten clinical notes as well as genomic data.